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Summary:  It  is  shown  that  every 
non— void  weak  closed  convex  set 
of  distributions  on  the  unit 
interval  is  the  set  of  all  op¬ 
timal  strategies  for  one  player 
in  some  game  with  continuous  pay¬ 
off  over  the  square. 


OPTIMAL  SETS  FOR  GAMES  OVER  THE  SQUARE 
I.  Glicksberg  and  0.  Gross 


In  this  note  we  shall  call  the  set  of  all  optimal 

strategies  for  one  player  in  a  game  an  optimal  set.  Optimal 

sets,  in  two— person  zero— sum  games  with  continuous  payoff 

have  the  obvious  properties  of  convexity  and  closure  in  the 
★ 

weak  topology,  so  that  one  might  ask  whether  these  pro¬ 
perties  characterize  such  sets.  The  answer,  in  the  case  of 
compact  metric  pure  strategy  spaces,  is  in  the  affirmative, 
as  will  be  shown. 

We  shall  begin  with  games  over  the  square.  Since  the 
space  0(0,1),  of  continuous  functions  over  the  unit  interval, 
is  separable,  the  space  S  of  distributions  over  the  unit 
interval  is,  in  the  weak  (w  )  topology,  compact  and  metric. 
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Let  us  set  ( lD  ,f )  =  J  (x)df  (x)  for  (|  £  C(0, 1 )  and  f  a 

distribution,  so  that  {fj(<f  ,f)  *  a]  is  a  w*  closed  half 
space  of  distributions.1  The  fundamental  fact  that  we  need 
is  that  any  non-void  w  closed  convex  set  K  of  distributions 
is  the  intersection  of  a  sequence  of  such  half  spaces.  This 
can  be  established  via  Brouwer's  Reduction  Theorem  (cf. 
Hurewicz  and  uallnan,  Dimension  Theory,  Index)  which  states 
the  following :  In  a  space  satisfying  the  second  axiom  of 
countability  a  family  of  closed  sets,  with  the  property  that 
every  decreasing  sequence  of  elements  of  the  family  has  its 
intersection  in  the  family,  contains  a  minimal  (or  irreducible j 
element.  S  certainly  satisfies  the  second  axiom  of  countabilit 
as  a  compact  metric  space,  and  if  we  take  as  our  family  of 
closed  sets  all  countable  intersections  of  half  spaces  which 
contain  K,  we  clearly  may  apply  the  theorem  to  obtain  a 
minimal  set  Kq  which  is  the  intersection  of  a  sequence  of 
half  spaces  and  contains  I\.  But  certainly  it  can  be  no 
larger  than  K,  for  if  f  is  in  K  but  not  in  K  then  we  have 
a  closed  half  space  H  containing  K  but  not  f,  so  that 
AqH  H  is  m  the  family  and  properly  contained  in  Kq  contra¬ 
dicting  the  minimal  character  of  K  .  Thus  we  may  write 


We  may  clearly  take  such  functions  ^  and  constants  a 
to  be  bounded  by  1 ,  as  we  shall  do  below. 
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K  -  Q  (f|f£  S  and  (Lfn,r)  i>  aj  . 

We  may  now  construct  a  game  over  the  square  having 
K  as  the  optimal  set  for,  say,  the  maximizing  player.  ,« 
set 


n  ~  1)2, 


> 


and  extend  M  to  a  continuous  function  over  the  square  by 
setting  IT{x,Oj  =  0  and  interpolating  linearly  along  vertical 
lines.  since  K  is  non— void,  we  have  clearly 


l  M(x,-g)  df  (x) 
u  n 


1 

n 


<  Fn'f) 


*  0 


for  all  n,  and  thus  for  all  y 


J  M(x,y) df (x)  ^  0 

for  f  h  K.  Since  Fi(x,0)  =0,  0  is  the  value  of  the  game, 

and  we  see  that  a  distribution  f  is  optimal  only  if 

(  ~  an  "  0  l°r  a11  n>  or  that  f  is  in  K.  Thus  K  is 

tiie  optimal  set  for  the  maximizing  player  in  this  game. 

In  the  case  of  a  metric  pure  strategy  space  a  for  the 

maximizing  player  the  procedure  is  similar,  inasmuch  as 

C(n)  is  again  separable  (this  is  only  true  when  a  is  metric, 
so  that  the  method  used  for  the  square  can  only  extend  to 
this  case)  and  again  we  obtain  our  set  K  as  the  intersection 


of  a  sequence  of  half  spaces.  In  order  to  construct  the 
appropriate  payoff  we  must  require  the  minimizing  player's 
pure  strategy  space  3  (which  we  assume  compact  though  not 
necessarily  metric)  be  infinite.  (Indeed  if  B  contains 
just  n  points  then  trie  maximizing  player  always  may  play 
just  n  points  and  some  sets  K  will  not  be  optimal  sets.; 

since  3  is  infinite,  at  most  one  point  y  in  3  has 
the  property  th at  each  of  its  open  neighborhoods  has  a 
finite  complement  (if  we  had  two  such  points  we  would  have 


disjoint  neighborhoods  with  finite  complements,  and  tne 

space  B  would  be  finite;.  Choose  a  point  y1  f  v0  ana  an 

! 

open  r.einhocrhoou  Wj  of  y ,  for  which  V.  1  (the  complement  of 
bd  j  is  infinite,  further,  a  neighborhood  Vj  of  y,  for  which 


V]  C  '..'-i  (3  1  s  of  course  regular;  .  Since  wj  is  an  infinite 

compact  space  we  may  find  by  the  same  argument  a  point 


y^  r  wj  with  a  relative  open  neighborhood  T  j.  hi  w ,  (where 

1 

is  open  in  3)  with  infinite  complement  in  .<  j  ,  and  thus  by 
the  regularity  of  a  an  oner,  neighborhood  V2  of  y^  for  whic 


V  ~  f  V,  =  0.  The  relative  complement 


in  .. ,  of  inf  ii, 
infinite  compact 


space,  s,-.c  thus  by  induction  we  obtain  a  sequence  (y  i 
of  ooints  and  • V  -  of  pairwise  disjoint  open  neighborhoods. 
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Let  y  £.  U  ,  U  cV  -where  U  is  open,  and  let  h  be  a 
continuous  function,  0  4  h^  ^  1  ,  hn(yri;  =  1,  which  vanishes 
outside  Un,  and  define  M  by 

M ( x , y )  =  ~  hn ( y )  [lfn(x)  -  aj  , 

where  K  =  C\  jfj((^n,f)  -  a^[  .  Since  at  most  one  term  of 

the  sum  differs  from  zero  In  is  well  defined;  it  is  easily 

seen  to  be  continuous.  11  or,  given  &  >  0  and  a  point 

(x0,y0)  £  AxB,  if  y0£  U  Vn  then  yQ£  VR,  and,  in  nxVk,  the 

function  is  ^  hk(y)  df ' ^ ( x )  —  and  neighborhoods 

U  of  x  and  V  of  y  exist  for  which 
o  J  o 

j  M  ( x ,  y )  -  fl(xo,yo)  j  <  £  for  x  £  U  ,  y£V, 
by  virtue  of  the  continuity  of  h^.  and  Cj)^.  If  v  Qt  O  ^k 

(  -p  ) 

then  v  .  has  for  each  n  a  neighborhood  V  J  for  ’which 
-  o 

V  Rinu,  =  0,  k  =  1,...,n,  so  that 

i id ( x , y j  j  <  -•  for  x  8  A,  y£  V^n' 
whence  h.  is  continuous. 

Since  B  is  compact,  -y  ^  has  at  least  one  cluster 
point  vQ ,  and  clearly  we  must  have  K(x,y  i  =  0  for  all  x. 
Since  ]  M(x,v)df(x}  =  JZ  -  hn(y)  [(tPn,fi  ~  anj  "  u  for 
f  £K,  the  value  is  0,  and  f  is  optimal  only  if 
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jM(x,yn)df(x)  -  irifn.n  ~  >  ° 

or  f  £  K. 

In  summary:  If  the  pure  strategy  space  of  the  max¬ 
imizing  player  is  compact  metric  and  that  of  his  opponent 
is  compact  and  infinite,  every  w"  closed  convex  set  of  his 
mixed  strategies  is  an  optimal  set  for  some  continuous 
payoff. 

Unfortunately,  this  does  not  have  an  obvious  bearing 
on  the  important  problem  of  determining  structure  of 
solution  sets,  i.e.  the  pair  of  optimal  sets  in  a  game, 
not  all  possible  pairs  of  optimal  sets,  for  example,  are 
attainable.  Consider  the  following  special  case  on  the 
square.  Let  the  optimal  set  for  the  maximizing  player  be 
the  uniform  distribution,  f(xj  =  x,  and  that  of  the  min¬ 
imising  player  be  the  set  of  all  distributions.  Suppose  it 
is  the  continuous  payoff  of  a  game  ’with  this  solution  set, 
arid  let  the  value  of  the  game  be  v.  since  any  pure  strategy 
is  optimal  for  the  minimizing  player  K(x,yj  L  v  for  all 
x,y.  If  M(x,y)  <  v  for  some  point  in  die  square,  then 
obviously  this  holds  in  a  neighborhood  and  Jh(x,yjdx  v, 
which  contradicts  the  optimality  of  f.  Therefore  id  =  v, 
and  all  distributions  are  optimal  for  the  maximizing  player 


a  c  o  nt  ra  d  i  ct  i  on . 


